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ABSTRACT 

The Automation Technology Branch of NASA Langley 
Research Center has been researching automation 
and robotic techniques for space operations 
since 1979. This branch has developed and 
currently maintains the Intelligent Systems 
Research Lab. The lab houses a collection of 
computers and robotic peripherals that have been 
organized Into a simulation testbed for tele- 
robotic research. This testbed Is being used to 
Investigate and develop techniques for tele- 
robotic on-orbit operations, such as assembly of 
large space structures and servicing and repair 
of spacecraft. 

The branch has on-going work In many areas. 
Manipulator research Includes dual -arm coordi- 
nation studies, space manipulator dynamics, 
end-effector controller development, automatic 
space structure assembly, and the development of 
a dual -arm master-slave telerobotlc manipulator 
system. Sensor research Includes gravity- 
compensated force control, real-time monovision 
techniques, and laser ranging. Artificial 
Intelligence techniques are being explored for 
supervisory task control, collision avoidance, 
and connectionlst system architectures. A 
high-fidelity dynamic simulation of robotic 
systems, ROBSIM, Is being supported and 
extended. Cooperative efforts with Oak Ridge 
National Laboratory have verified the ability of 
teleoperators to perform complex structural 
assembly tasks, and have resulted In the 
definition of a new dual -arm master-slave 
telerobotlc manipulator. 

This paper presents an overview of the facili- 
ties and research thrusts of the Automation 
Technology Branch, and Includes a bibliography 
of research results and technical contacts for 
each research area. All technical contacts 
named are In-house personnel of the Automation 
Technology Branch. 

INTRODUCTION 

The Automation Technology Branch of NASA Langley 
Research Center has been researching automation 
and robotic techniques for space operations 


since 1979 (ref. 1). Early Investigation 
established both the role of the branch In 
emphasizing the system Integration aspects of 
telerobotics (ref. 2), and the need to provide 
an evolutional development of teleoperators 
toward Increasing levels of Intelligent auto- 
mation. In examining NASA mission requirements 
for space automation, the tasks of structural 
assembly and satellite servicing were chosen as 
research foci (ref. 3). 

TELEOPERATOR AND ROBOTIC TESTBED 

The Automation Technology Branch maintains the 
Intelligent Systems Research Lab (ISRL), which 
houses a collection of telerobotlc subsystems 
organized Into a modular virtual architecture 
(ref. 4). This architecture, designated the 
Teleoperator And Robotic Testbed (TART), 
provides an environment where teleoperator and 
robotic technologies may be studied at the level 
of abstraction that best meets the researchers* 
needs. TART hides maqy of the low-level Imple- 
mentation details from the user and Is defined 
by well -documented and tightly-controlled data 
structures having specific access mechanisms* 

TART Is a layered product in which each suc- 
cessive layer provides additional capability to 
the system. Currently, five layers are Imple- 
mented: (1) user, (2) system, (3) scheduling, 

(4) communications, and (5) servo/sensor. The 
lowest four layers of TART accomplish most of 
the detailed programming and error checking 
required by user applications. The technical 
contacts for ISRL and TART are F. Wallace 
Harrison and C. Henry Lenox. 

TELEROBOTIC SYSTEM SIMULATION 

The TART architecture has been used to develop 
the TeleRobotlc System Simulation (TRSS), a 
real-time, man-1 n-the-loop simulation of tele- 
robotlc operations. Early TRSS studies used 
computer-generated graphics to Investigate the 
effects of time delays and teleoperator control 
modes on a precise alignment task (ref. 5). 

Later studies developed efficient algorithms to 
handle singularities In serial link manipulators 
(ref. 6). These techniques were demonstrated 


46S 


on the ISRL manipulators (ref. 7). Most 
recently, TRSS has been used to Investigate 
telerobotlc structural assembly tasks for 
application to Space Station contructlon. 

Current TRSS control strategies are based on 
resolved motion rate control operating at 25 
Hertz. Individual joint rates are Integrated to 
provide joint positions, which are transmitted 
to servo-level pocesses resident In the 
manipulator controller. Operator control Inputs 
can be referenced to arbitrary reference frames 
and combined with sensor-derived control 
signals. The technical contacts for TRSS are 
Donald Soloway and Bobby Glover. 

Manipulator Control 

A standardized set of homogeneous transform 
structures has been devised and Implemented In 
TRSS to provide a generic control reference 
structure (ref. 8). By thus providing for the 
selection of arbitrary control reference frames, 
multiple manipulators can be simultaneously 
controlled Individually or orchestrated to 
coordinate on a single task. TRSS currently 
Incorporates two manipulators, which can 
cooperate In performing tasks such as 
positioning a long strut for connection to a 
node for structural assembly. The contacts for 
this work are Donald Soloway and L. Keith 
Barker. 

Research continues with the Massachusetts 
Institute of Technology In tjynamlc control of 
manipulators In space. A virtual manipulator 
concept has been developed which facilitates the 
planning and control of the motion of manipu- 
lators mounted on spacecraft, thus minimizing 
the degrading consequences of manipulator/vehi- 
cle clynamlc Interactions (ref. 9). Addition- 
ally, the branch Is supporting research In the 
control of flexible manipulators at the Georgia 
Institute of Technology. The contacts for these 
efforts are Jack Pennington and Donald Soloway. 

An In-house effort Is currently providing 
separate programmable controllers for each joint 
of the PUMA manipulators. This will allow 
research Into alternative servocontrol 
strategies, Including model -ref erenced adaptive 
control (ref. 10). The contact for this work Is 
Donald Soloway. 

Interest is growing In the possible use of 
trained neural networks to replace the need for 
kinematic manipulator control. Investigation Is 
In progress of neural net capabilities and 
architectures. The contacts for these efforts 
are Donald Soloway and Nancy Sllwa. 

Operator Interface 

In addition to manual control, an Interactive 
menu-driven Interface Is used In TRSS to provide 
a higher level of control abstraction to the 
operator, In effect automating some low-level 
task operations (ref. 11). This Interface Is 
organized such that more complex task operations 


can be described as a script of elementary 
operations and invoked as a single command 
primitive. 

As this menu Interface has evolved. It has 
become Increasingly complex. Accordingly, an 
effort is now underway using expert system 
technology to automatically generate menu 
scripts based on high-level task requirements. 
This provides the operator with Increased super- 
visory control. The contacts for this work are 
Nancy Sllwa and Eric Cooper. 

Sensors 

Sensor-derived control signals are essential to 
the automation of tasks In an uncertain tele- 
robotic environment. TRSS uses both 
force/torque sensing and machine vision 
processing to assist in controlling the 
manipulators. A wrist-mounted, six degree-of- 
freedom force/torque sensor provides force and 
torque data that are processed into rates. 

These rates are then summed Into the manipulator 
control rates to provide compliance, obstacle 
avoidance, and gravity compensation for loads 
carried by the manipulators. Additional 
force/torque sensors In the end-effector have 
also been used for fine motion compliance In 
dexterous tasks. The technical contacts for 
this work are Donald Soloway and Marlon Wise. 

Vision processing In TRSS currently emphasizes 
the determination of position and orientation of 
a marked part for acquisition by the manipula- 
tors (ref. 12, 13). This Is done with 
quadrangle projection techniques, using a 
minimum of four identifiable target points and 
the principle of perspective transformation. 

This allows fast, robust automatic object 
acquisition by the telerobot. 

Elastic matching techniques are also being 
researched In ISRL for automatic object recog- 
nition. A linear programming method called Goal 
Programming has been adapted to the elastic 
template matching approach to pattern recog- 
nition (ref. 14). This approach has been 
successfully applied to 3-space location of an 
isolated object, shape determination of isolated 
planar figures. Image compression/restoration, 
and shape decomposition. 

ISRL sensing capabilities are currently being 
expanded to Include laser ranging. With support 
from the National Bureau of Standards and the 
U.S. Army, the branch has worked with Digital 
Signal Corporation to produce a high-speed, 
extremely precise range Imager for the ISRL. The 
concept for this Imager Is based on the FM radar 
principle which makes use of the coherence and 
tunablllty of Injection laser diodes (ref. 15). 
Work Is currently In progress for applying this 
technology to produce an end-effector-mounted 
point-ranging sensor. Contacts for vision and 
laser research are Plesent Goode and Karin 
Cornils. 
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End-Effectors and Tools 

TRSS has been using an end-effector fabricated 
at Langley from designs by the University of 
Rhode Island (ref- 16). This end-effector, a 
parallel jaw gripper, has proximity and cross- 
fire sensors for the detection of workpieces, 
limit and overload sensors, and manually- 
exchangeable fingers (ref. 17). The Automation 
Technology Branch has researched several 
variations of this end-effector. Including 
finger-mounted force/torque sensors, auto- 
matically exchangeable ratcheting tools, and 
several task-specific gripper styles. 

A microprocessor controller has been developed 
for this end-effector, with a sophisticated 
monitor to examine and change gains, speeds, and 
sensor values, and to move the grippers. This 
controller has been Interfaced Into the TART 
architecture to provide automated gripping and 
gripper-based sensing in TRSS (ref. 18). The 
technical contact for this work 1$ Marlon Wise. 

Collision Avoidance 

The branch has supported several efforts in 
collision avoidance and trajectory planning. 
Including hextree environment modelling (ref. 
19), freeway trajectories (ref. 20), gaussian 

configuration spaces (ref. 21), and dual -arm 
collision avoidance using velocity constraints 
(ref. 22). Research Is currently In progress 
In-house establishing collision avoidance 
criteria for telerobotlc environments, and 
developing a real-time collision avoidance 
monitor using abstract geometry and lazy evalu- 
ation techniques to avoid unnecessary calcu- 
lations. The technical contact for this work Is 
Nancy Sllwa. 

System Architecture 

In addition to the continuing enhancement of the 
TART virtual architecture. In-house research Is 
continuing in the use of behavioral networks as 
a control architecture for telerobotlc systems. 
Behavioral nets, a variant of connectlonlsm, 
could provide a unified approach to combining 
high-level intelligent task control with low- 
level sensor and actuator control (ref. 23). 

This structure is also being Investigated for 
use In Interactive dynamic planning and schedul- 
ing systems. The contact for this work Is Nancy 
Sllwa. 

ROBOT SIMULATION 

The Automation Technology Branch supported the 
development of ROBSIM (ROBot SIMulatlon), a 
high-fidelity, dynamic, off-line design and 
analysis tool for robotic systems and environ- 
ments (ref. 24). This product, originally 
developed by Martin-Marietta, Is being extended 
and enhanced by both In-house personnel and 
Grumman contractors. A real-time 3-D graphics 
display. Improved user Input interface, and 
Interfaces to collision detection algorithms are 
upgrades which are currently In progress. This 


product has been distributed to more than 20 
universities and research groups. The contacts 
for this work are F. Wallace Harrison and 
William Doggett. 

TELEOPERATOR PERFORMANCE VERIFICATION 

Teleoperated systems have so far seen only 
limited commitment for use in space due to the 
uncertainty of such systems' capabilities to 
perform complex realistic space tasks and of the 
time required to accomplish such tasks. The 
Automation Technology Branch, In cooperation 
with Oak Ridge National Laboratory (ORNL), has 
attempted to demonstrate the feasibility of 
teleoperated space operations and has 
established a database of task completion times 
(ref. 25). 

Assembly Concept for Construction of Erectable 
Space Structures (ACCESS I) was a structural 
assembly flight experiment Intended to study and 
verify the ability of astronauts to assemble in 
space a repetitive truss structure typical of 
that proposed for Space Station. Using the 
master-slave dual -arm manipulator (M-2) and 
highly skilled operators at ORNL, the ACCESS I 
experiment was duplicated In a controlled 
environment. This experiment proved that tele- 
operators have sufficient dexterity and control 
to perform such tasks In a timely manner without 
damage to the task components or to the manipu- 
lator system. Potential hardware modifications 
have been Identified, and a data base of per- 
formance metrics has been established. The 
contacts for this work are Walter Hankins and 
Randolph Mixon. 

SPACE STRUCTURE ASSEMBLY SIMULATION AND LAB 

In cooperation with the Langley Structures 
Directorate, the Automation Technology Branch Is 
investigating the automated assembly of large 
tetrahedral truss structures, such as would be 
used for large space antennae. Branch 
researchers have developed a real-time, 3-D 
perspective graphics simulation to be used In 
configuration analysis and development of 
assembly techniques. Since this analysis 
requires manual Input, necessary components of 
the simulation Include a command Interpreter, a 
truss naming convention, a robotic system 
knowledge base, and an automated assembly 
sequence based on simple common substructures. 
Simple rules have been developed to allow an 
untrained operator to understand the assembly 
sequence and to successfully intervene in the 
event of system problems. An expert system 
approach is being Investigated to minimize truss 
structure moves, potential Interference, and 
robot arm base moves. The contacts for this 
work are Ralph Will and Sixto Vasquez. 

The Automation Technology Branch and the Langley 
Structures Directorate have Initiated the 
development of a laboratory facility to verify 
and demonstrate this approach to telerobotlc 
construction of large space structures. The 
objective of this research Is to design and test 
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structural elements, fasteners, end effectors, 
and tooling for telerobotlc assembly of space 
structures, and to develop design criteria for 
manipulators, sensors, computers, and 
human/machine Interface for systems for large 
space assembly. Future research with this 
facility will Include enhanced sensing capabili- 
ty, curved structure assembly, repair of damaged 
structure components, and the automation of 
additional contructton tasks, such as cabling 
and panel installation. Contacts for this work 
are Marlon Wise and Jack Pennington. 

SPACE MANIPULATOR DEVELOPMENT 

The Automation Technology Branch Is working with 
Oak Ridge National Laboratory (ORNL) in develop- 
ing a new concept In telerobotic manipulators 
(ref. 26). The Laboratory Telerobotic Manipu- 
lator (LTM) design combines the best capabili- 
ties of teleopera ted manipulators and robotic 
manipulators. The objectives of the LTM program 
are: 

1. Provide prototypical laboratory 
hardware for NASA ground-based research 
In shared teleoperator /autonomous 
control, teleoperator control methods, 
and space task demonstrations. 

2. Provide a high quality, dexterous, 
dual -arm, force-reflecting teleoperator 
to maximize the commonality to 
astronaut EVA task performance. 

3. Provide robotic features for laboratory 
research and an evolutionary path 
toward system autonomy. 

4. Provide configuration and performance 
consistent with a space flight system. 


Unique features of the LTM Include (1) 
replicated joint concept for reduced design and 
fabrication cost, (2) dual-arm system for two- 
handed tasks and tooling, (3) differential 
traction drive mechanism for low backlash and 
high efficiency, (4}redundant kinematics for 
singularity and obstacle avoidance, (5) an 
Interface to the GSFC/JPL Smart End-Effector, 
and (6) a hierarchical, distributed digital 
control system, with graphics-oriented operator 
Interface. 

LTM is configured as a dual -arm master-slave 
system. Each $even-degree-of-freedom arm has 
pitch and yaw motions In the shoulder, elbow, 
and wrist, plus roll motion at the wrist. Two 
basic two-axis modules provide speed and torque 
options, and are used in both the master and 
slave arms. 

The LTM control architecture supports both 
robotic and teleopera ted operations with real- 
time human control. The system will be entirely 
digital, using 32-bit microprocessors, standard- 
ized bus structures, and software implemented in 


high-level languages such as C, Pascal, Forth, 
and Fortran. 

Detail design and fabrication of the first 
prototype of this space telerobotic system has 
begun, with intlal operational planned for 
mld-1988. The Langley contacts for this work 
are Alfred Melntel and Jack Pennington. 

INTERCENTER COOPERATIVE EFFORTS 

Members of the Automation Technology Branch 
serve as consultants for and participants In 
several NASA automation and robotic efforts. 
These efforts Include the Mars Rover project, 
the Flight Telerobotic Servicer project, the 
Telerobotic Demonstration Program, and the 
Systems Autonony Technology Program. All branch 
publications are available upon request. 

CONCLUSION 

The Automation Technology Branch has developed 
an excellent telerobotic system research 
facility and maintains a group of In-house 
researchers who are competent not only in tele- 
robot component technology, but also in the 
integration of such technology into specific 
application systems. While pursuing Independent 
research to extend the state of the art In 
telerobotics for space applications, the branch 
is also cooperating with other research groups 
to solve specific application problems, 
advancing the use of telerobotics to fulfill 
NASA mission objectives. 
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